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ABSTRACT 


A procedure for determining the rank of a quadratic form 
is outlined by Cramér, [1] and Hald [2]. Additional theoret- 
ical verification of this procedure is presented and the 
results are illustrated with applications in the analysis 


of variance. 
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I. INTRODUCTION 


A comparison of several sets of observations drawn from 
normally distributed populations can be performed by means 
of the statistical procedure known as the analysis of var- 
iance. The justification for the statistical procedure in 
the analysis of variance depends directly upon the apvplica- 
tion of Cochran's Theorem stated below. 

Cochran's Theorem Let X = (X) Xone - eX ) be distributed 


Nn 


as N,, (0,2) and suppose 


where Q. 1s a quadratic form of rank ne, I= epee em 
Q, (KX) 1--- Q(X) are mutually independent and Q, (x) is dis- 
tributed with n degrees of freedom, i=l,...,k, if and only 


ee 


Cochran's Theorem formally relates (a) the degrees of 
freedom of a we randem variable, Q(X), with the rank of its 
associated observed variate, Q(x), when X is N (0-2) and 
(b) the sum of the degrees of freedom of a set of yxy” random 
variables with the dimension of the random vector X; the 


: 2 ' 
independence among the x” random variables is a consequence 


CpeentS rebationship [2]. 


Hence, 1f a statistician is collecting a random sample 
from a normally distributed population and if the sum of 
squares Of the observations from the random sample, x = 
(X)pe+- eX), equals the sum of several quadratic forms in 
xX, Say Qyre ee Qee he must show that the sum of the ranks of 
these quadratic forms is equal to the number of total obser- 
vations before he can conclude independence of the Q.'s, 
i=l,...,K, and assign re probability distributions to them. 
In the analysis of variance these guadratic forms, when 
divided by their ranks, represent independent estimates of 
an unknown variance 5? associated with a random variable 
vector Y which is N_(u,o°I). The N 60-2) hypothesis of 


Cochran's Theorem becomes satisfied upon letting 


Since the normalized quotient of independent és variables 
is an F-random variable, F-statistics, which are used to 
test hypothesis concerning uw, can be formed from the ratzo 
of the quadmatic forms 1x 

In turn then, it can be seen that the application of 
Cochran's Theorem depends upon the determination of the ranks 
of the quadratic forms tex eee eener cielo nm 


i 
y xe = OQ, (x) + Qo (x) +. . - + OY (x) 


Cramer [1] gives a procedure for determining the rank 


of quadratic forms as follows: 


" If Q may be written in the form Q = ie + nae is 
where the L. are linear functions of Xp ree X, and if there 


are exactly m independent linear relations~ between the L., 

then the rank of Q is k-m. ...." 
Cramér calls this a Proposition. 

Likewise, Hald [2] states a similar procedure as a def- 

Tiga, fo} at = 

"The number of degrees of freedom for a set of variables, 

Lireee rly, will be defined as follows: Let the k variables 
Lyreee hy be linear functions of n stochastically independ- 
ent variables, Xpress Xe which are assumed to be normally 
distributed with parameters (0,1). If m independent lin- 
ear pele iene exist between the k variables, Lyre-- hy, 
the number of degrees of freedom is k-m. The number of 


degrees of freedom for the sum of squares 


is defined as the number of degrees of freedom for the k 


variables L : eae 


yor hy 


t Both Cramér and Hald point out that the m linear rela- 
tions between the L's are linearly independent. Formally, 
a linear relation has the form 


L, + wee + c, by, —a 


TieGe Ene CC. (cme sCOnatdmeomonGenot, alle zZeueasWaen Several 
linear relations of this form exist, they are called inde- 
pendent, if the corresponding vectors c = (c),-..,¢C,) are 
linearly independent. 


Cramér's proposition is stated, but not proved. Hald, on 
the other hand, precludes the necessity of proving the same 
proposition by calling it a definition. In either exposition 
no detailed theoretical verification is made of the procedure 
for determining the rank of quadratic forms. It is the in- 
tent of this thesis to (1) state and prove basic theorems 
which can be used to determine the rank of quadratic forms 
in the way presented by Cramér and Hald and (2) illustrate 


the use of these theorems in the analysis of variance. 


Il. MATHEMATICAL BACKGROUND 


The theory which is to be developed concerning the rank 
of quadratic forms depends upon several mathematical results 
from matrix algebra [3,4]. This chapter outlines the perti- 
nent mathematical definitions and theorems that are necessary 


to develop this theory. 


A. MATRICES 

A matrix A has elements denoted by =e where i refers to 
thewnousendsjste thescolumn. if A denotes the matyix, then 
A" denotes thé transpose of, A, and re the inverse eae. 
The symbol |A| is used to denote the determinant of A. The 
VICneE Mo mematriex 1s denoted by Dysande) ethos uilllimaeiee 
The dimension of a matrix is the number of rows by the num- 
ber of its columns, e.g., nxm. A matrix A of dimension nx] 
is called a column NOG EOLA: its transpose A', a row vector. 
iiesrank sof aimatrix A is denoted by (A). ™§ Euclidian yn-space 


is symbolized by Ent 


Given matrices A = se 3) and B = Dea) where the number 
of columns of A equals the number of rows of B, the product 
AB = C= ee PioeCehite dmaomene Mlatett aC maith rie oq th 


= era ilienttn vectors will be indicated by round brackets, as 


x = (Xp pee X) i row vectors will be indicated by square 


brackets, as x = [X),---,/%,]. 


n 
element equal to ) 
k=1 


b A+ B=C gives ant Dee ae 


Sok °kq’ = = is} 13) 


provided A and B have the same dimension. dma Viis §agccalar 


and A a matrix, then kA means the matrix whose ioe element 


is See A diagonal matrix D is a Square matrix whose off- 
diagonal elements are all zero; D = ey where aa = QOif 
i 7 j. “A matrix is called symmetric whenever A = A’. ITeec 
is an nxn matrix such that CC' =I, then C is said to be an 
orthogonal matrix, and C' = Coe 
Meoreirec . Wh Get AA) — = TC — tee ee 
3 


Theorem 2.2~> Let A be nxn, symmetric and non-negative. 
Then there”exists a non-Singular matrix €@ such that’ C'AC = 
(dos) where d. {0,1}, i=l,...,n and the rank of A equals 
the’ number of non-zero d,'s. 

Theorem”2.3 If A is an mxn matrix of rank r,“and 12 B 
rs a nxq™matrix such™that ABW= 0, then “the rank” Of "B Calaoe 
exceed n-r. 

Theorem 2.4 Consider the sum of k matrices of the same 


dimension, A, + A. +. ok then 


Z ° k! 


B. QUADRATIC FORMS 
If A is an nxn matrix and x = (x +X) is an nxloyvec 


tor wakth pth element x. then 


3The symbol ae is called the Kronecker delta and stands 


for 1, if i=j; 0, if if}. 


10 


n n 
Ol =x"Axk = | } 
eel 


By 225s 
as Called a quadratic form in x. ‘The quadyatic form x*‘Ax and 
its matrix A are called positive definite if whenever x # 0, 
on J 8; OST rive. Semi—-derinite whenever x Ax > 0 for aif 

x # 0 and x'Ax = 0 for some x # 0; and non-negative whenever 
x'Ax (or A) is either positive definite or positive semi- 
definite. (Any non-negative matrix A of a quadratic form 


x'Ax 1s assumed symmetric for mathematical convenience and 


@ecs net dlter the vdalvue of x'Ax ,sirice 





n n n mn SWa..2-an= ) 
x'Ax = ) a a ) ) 25 re 
i=l j=1 74 J i=1 j=1 3 
(A+A') 
=a =k 
= p) = 





where is symmetric.) The rank of a quadratic form x'Ax 


+h 
2 
equals the rank of A. 


Lal 


lil. “RANK SOF UADRATEG FORMS 


This chapter (1) defines linearly independent linear 
forms and linearly andependent linear restrictions on slam cm, 
forms and (2) develops the theory of rank determination of 


quadratic forms. 


A. LINEAR FORMS 
Let »4 # 0 be an nxl vector. If x = (Xp ree Xx ) ls 


Ea! then the linear combination 
n 
L(x) = A'x = ) ex 


of components of x with coefficients) fsem. iasmealledaa 
linear formewith, the associated vectoms) . ~ Since mais 
scalar, A'x = x'h. The square of a linear form 1s ajquaae 


ratic form since 


L*(x) = (A'x) (A'x) = (x'A) (A'x) = x" CAA") x. 
Here, AX' 1S nxn symmetric. The rank of L? (x) = F(x) Xoo 
= r(AA') = r(A) = 1 by Theorem 2.1 since A # 0. So in gen- 
eral, AX' is not positive definite. However, since L (x) = 
(A'x)?, L? (x) is always non-negative. 
lige Ly, greee rly are linear forms in EA! they are said to 


be Tine aay, Independent if their associated vectors 
AyrAgre++rsA, are linearly independent vectors in E, Meee 
the rank of the matrix A = (A,,A5,---,A,) equals k. 


Theorem 3.1 Q(x) is a non-negative quadratic form in E, 


of rank k if and only if there exists linearly independem 


2 


linear forms Ly ,lo,--- rh such that 


k 
22 
Q(x) = } L(x) for every xeE_. 
es ‘ a “3 n 
1=1 
Proof: Suppose Q(x) = x'Ax is non-negative with rank k 


and associated matrix A. By Theorem 2.2, there exists a 


HOon-singubat Matrix € Such that CVAc 


(diss4), d.c{0,1}, 


7 on -_ 
i=l,...,n. Define L,:E_>E, by L, (x) cix where c; is the 


jee row of ent, 71 =. oak. Then; L, is a linear form and 


letting z = (L, (x),...,L,(x)) = (¢)x,.--,¢'x), it follows 


ct 
> 
eh) 
ct 
IN 
lI 
10) 
Ix 
O 
K 
Ix 


= Cz. In that case, 


cf 2 a 2 
Sae—Z eC 'ACZ = gakeieo..)z = ) daze. = ) Auinaise). 


But, by Theorem 2.2, k is precisely the number of non-zero 
d.'s. Deleting those d. such that d. = 0 and renumbering 


subscripts, if necessary, yields 

oe 

Ole) e= Sc Ax — \ Li, em) . 
= —_— —_— == . _ 

1=1 
Since or 1s non-singular, the vectors Cyre ee Cy are linearly 
independent and so then are the linear forms by definition. 

Conversely, suppose Ly reese sly are linearly independent 

linear forms. Then, by definition, there exists k linearly 
independent non-zero vectors i 


-.-,A,, where A. 1S asso- 
=k —1 


ie 
Clated with L., it. Ena LS, 


igi 
L. (x) = ) 


ie 


for every xX = (Xp peers 


i-l,-..,k the masemeix 


Ay. os 


Ay 


es 


necessarily has rank k 


pendent, i.e., r(A) = 
Consider 
Q ( 
Now 
L* (x) = L. (x)L. ( 
i-- i= 
hence 


k 
Q(x) = ) x'(A,AL)x 
i=l 
2 
Aid 
k 
= t 
=e eS 
i=l 


a 


x) in E,. Letting A, = (As qreeer Asn 


pal AK1 
Ly ge” Tepe 
Mon on LES 


because the rows are linearly inde- 


Ke. 
k 
eile all 
i=l 
x) = (AEX) OAGK) = XT OAGAG) 


i=1 “+7 
NS sake 
2 
ne rm 
x 
pee ce \¢ nxn 
sigh ah Xe skp! 


14 


es) il call 5 i aes ee aa nT 5 il 
} F 2 } 
ee Ko —— ) ee Ne 
ar 2291 =a) 12 age i2 in 
neg = PX" x 
k k k , 
) Non ad ) ee ) A nxn 
sh 6 L el 
k 
= Aseaene res 1A) = ) ho: 
— = : = 
TySak 


Notice that A is symmetric. Thus, Q(x) is a quadratic form 
in x and it must follow that the rank of Q(x) equals r(A). 


Observing that A is,"im fat, the product of A and A', 


and, applying Theorem 2.1, r(A) = r(AA') = r(A) = k. Con- 
sequently, r(Q(x)) = r(A) = k, and since Lé (x) is non- 


negative so also then is 


LE (x) O60). “GOe ED 


B. LINEAR RESTRICTIONS 


A vector a = (,,---,a,) in E, is called a linear restric~ 


Epon Ohmic set lor lainear forms, {L,,---,L,} if a # O and 


~ 


a'L(x) = J a,b, (x) = 0 


NES 


As will be seen, a linear restriction has the effect of 
reducing the rank of a quadratic form by one. Another linear 
restriction will further reduce the rank, only if it and the 
first are linearly independent. In general, it is important 
to find the total number of linearly independent linear 
restrictions on a given set of linear forms, {Ly ,---,L,}, sibel 
order to determine the rank of the quadratic form, 

Zz 
ik 


k 
Q(x) = ) “tte 
i=l 


Theorem 3.2 If there are exactly m linearly independent 
linear restrictions on the linear forms, Lyreee rly, (m<k) 


then the rank of 


is k-m. 
Proof: Suppose press, are linearly independent linear 
restrictions on the linear forms, Lireeerlys where a. = 


(sprees Oey) for.,each i=1,..... ,M. J eben 


k 
L.(x) =") ap. ee 
J — 


k 
Loi j 


fOmvall x mn EA! i—l,..ame,. Waere se is associated with the 


linear form ee for each j=l,«..,k. | Recall that 


(x) = x'(AA')x 


Ih 


where 


dll B32 alin 
A‘ = - : = : 
Matt Men Me 
= k “f 
Retyav=) | a) ) then AA'x = |) a ,A.x | = 0 
j=l 
k 
oan ) Oa Aax 
me) mR o 
for all x in E,. Hence AA' = 0. r(A) = m by hypothesis, 


aicwoy theorem 253; rth") < k=m- 
Suppose m is the maximum number of linearly independent 


linear restrictions on the linear forms, Lire-- rh and 


le! 
mow <sk i een A) —WTeeeere SXIStS an ix. sub—maer1 x 


A* of A such that |A*| # 0. Without loss of generality, let 


Wale te Slur 


a e e e a 
mi mm 


* t = ie t t t 
Since r(A') < k-m, the last k-m rows of A', Amer ct dy ; 


among others, are linearly dependent. Then there exist 


scalars Dyreee Dy, not all zero (say b #0), such that 


baie: 2 Gish) 


gaa r = 2 


k = 


le 


Let 8 = (0,... ,Oifb b.», Then cé@tainly, 


mt’ °°? Py 
} } 

BL, (x) = b, Aix = | Dig Ei) X ggilx = 90 
i=)? mel = nfl = 


so that press A ,8 are linearly independent. For suppose 


=m 
C, Gy oe: oie oO Cae = O- 
Then 
C1514 + . - + Cm = 0 
ralealrn a mmm - 
Sq Sa m+1 : : mm m+ oa) =” 
ST tse tC ee eee 
or letting c = (Creer), the first m equations can be 
written A* c = 0. “Sance A* is nom-singular, ¢ = 0, thas 
is, Cy + 2 > cae O, and the last k-m equations become 
Tel ae, oe 
le = % 
But By # 0, hence Chr = O. Consequently, Qirese O78 are 


linearly independent contradicting the maximality of m. 
Hence r(A') = k-m and since r(A') = r(AA') by Theorem 2.1 


(Oem ee Vii. a Oe Dr 


Lye: 


Corollary 3.3 ff there is at least m linearly independ- 
Chie iuniear restmiuctiens jon the lamear fous, Lire-erly, (m<k) 


then the rank of 


fon alah ox 1p En is less than or equal to k-m. 
Theorem 3.4 The linear forms Ly rece rly are linearly 


independent if and only if there are no linear restrictions 


on Lor. rly - 

Proof: Suppose Lj,---,lL, are linearly independent and 
there exists at least one linear restriction, a = (a,,..--+,0,) 
on Lyre-- Ly such that a,b, ~ 2 © oe ay Dy = Q. Hence, one 
of the linear forms, say Lj, can be written as a linear com- 


bination of the remaining k-1l linear forms 


ety NK 
~~ sek (a, # 9) 
i. i 
ee var 
3 
where ae =a 7 a Hopes pis 
iL : 
Consider the vectors, Ayreesrdyr, associated with the 
linear forms, Lireee by, and the matrix formed by these 
vectors, 
i] 
a ay | 
Ie — s — 
vet dicn A | 


1:9 


where by hypothesis, r(A') = k. Now 


L, = BjrA,xX +. . - + BLALX 
k k 
= (2, BAG) sn (2, Sage ese 
which implies 
} 
ee ee 
— a vd 
Ay 7% M4 at [A57- rAy IB 
} 
Ba 
_ 
where 8 = (Bor--+7B,)- Hence, dy is a linear combination of 


the remaining k-1l rows of A', i.e., r(A') < k-1l which contra- 


— 


dicts the linear independence of the linear forms Lire+-ly. 
Therefore, there are no linear restrictions on Lir--- Ly. 
Conversely, suppose there are no linear restrictions on 


the linear forms, L Ly Letting m = 0 in Theorem 3.2, 


leer 
the rank of 


k 
Q(x) = ) L 


for all x in E, equals k-m = k. Since Le (x) is non-negative, 
so then is Q(x). Upon applying Theorem 3.1 the linear forms, 


Lireeerly, are seen to be linear independent. Q.E.D. 


20 


IV. APPLICATIONS TO ANALYSIS OF VARIANCE 


Knowledge of the rank of a quadratic form is essential 
in testing for the equality of means of k normal populations 
having the same variance. This statistical method is called 
the analysis of variance. This chapter demonstrates the use 
Sr elinearly andependentsiimear Bestrictwons Of linear forms 


to determine the rank of quadratic forms. 


A. ONE-WAY CLASSIFICATION 
Suppose that there exists k groups of independent obser- 


vations 


Y peeesy ry peeesyY peeesV peeesV 
TyAe in, alt 2n5 kl kn, 


from normally distributed populations with means Wyre ee eM 
all with the same variance 6+. Thus the model is 
We = oe + SEs i=... ok j= ie Ms 


where HW, are fixed constants and the 15 are independent 


8 6 8 2 
random normal deviates with zero mean and variance oo. 


Let <i a ae Consider the identity 
sigs = eo + (x. -x) + xX (1) 
where 
n. 
t= ee Bon, 5k 
1 j=l J 
= ale k _ 
x = = ) ar 
i=l 


Squaring both sides of equation (1) and summing over i and j, 


L=1y. + ee J=1,..- nm, yields the identity 


Awa, +nOee 


Since J prc is Nu, 07) then Se 2 is N(0,l) and 


is x7 (n) and has rank 


The ranks of Qi, Qo, and Q3, in turn, can be found by find- 
ing the number of linearly independent linear restrictions 
associated with each quadratic form and applying Corollary 
3.3 and Theorem 2.4. 


Consider first 


ave 
Sd comers: 
Q,(x) = (xo ee 
ih ae 2a ona 
where xX = alain Tacinee aad? acc RNa ce Let Ls 4 (x) = 
(x..-x.) = X%4'.x be a linear form in x where \.. is an nxl 
ij “i -ij- = -ij 
vector 
0 
i=) 
) n. rows 
u=1 
Bus 
_i 
rat 
aL 


ae 


a 
i=l 
oe | ae ----( ) on ogi row 
sal n. {; 2 
a 
ae 
1 
i=l 
= Se a ( ) n vat row 
n u 
cape u=1 
0 
: i=l 
n-( } n,) rows 
u=1 
0 nxl 
= 


Hor each i-1., wa-k theme’ Ieeasts angmal vector a, such that 


i) 


gi 
a 
4=1 J 1) 


| —a 
a:L(x) = 
gly 
1 = 
= ) (<=. 2=s 8) = 40 
eal iy 2 
where 
0 
7: 
) n,, rows 
: m= 1 
Ja 
ik 
1. = 
er . i=1 > 
ne ----( ) n_) row 
OIE 
0 nxl 


Z 3 


and 





L(x) = 
nxl 
Forming the matrix A = (a,,-..,a,) 
a) et 
. n, rows 
les: Ome, anes = axl 
OrUE 5 U 
: n, rows 
A= O_1_-_._._0 
C0! 2. db 
n, rows 


: se | nxk 


1t can be seen that the columns of Agjare linearly indépeng@eage 


© 
© 
1 


1.e., r(A) = k; hence by definition, the set of k vectors 
{dj rece Oy are linearly independent linear restrictions on 


the linear forms, ele 1 Bie epee ne ker Applying 


Coremlary 3.3; r(Q,) nk - 


24 


In a similar manner for 
Q,(x) = 


where x = (x peee eX) let 


L.(x) = Yn, (x,-x) (i=1,...,k) 


=n 


be a linear form in x where ds is a kxl vector 


i 
aes 
a: 
vn a 
A= [vay (2 - DL ----i"? row 

i 
vn. (— 7) 

Yn. (- =) kxl 
i‘ k 


Likewise, there exists one kxl vector a such that 


a k 
o L(x) 


ll 
mJ 


aL. (x) 


ll 
lad 


il 
lad 
5) 
I 
l 
x | 


Zo 


where ba 


a= and L(x) = . 
Ii kxl Vn, (xX, -x) x1 


Here ag»represents ae least cone lineam restriction onmeae 
eS Ae Oeil Ly (x) ,---/L, (x), angmayv Corollary 93.3 
Ibe SHE MAY - Q3 (x) = nx’ is the square of a single linear 


Out, L(x) = Yynx, and has rank, r(Q3) =i 


In summary, 


r(Q) =n 
r(Q,) < n-k 
r(Q,) < k-l 
r(Q3) = 1 


where Q = Q) aa Q. + Q3- Hence 
r(Q,) + r(Q.) + r(Q3) ene k - 1 + 1 Sn 
but by Theorem 2.4 
r(Q) =n < r(Q,) + r(Q,) + r(Q3). 
Consequently, 


r(Q,) + r(Q.) + r(Q3) = r(Q) 


and 
r(Q,) = n-k 
r(Q,)= k=l 
r(Q,) = 1 


From Cochran's Theorem the quadratic forms Qi, Qo, and Q3 
are linearly independent and are ve distributed with n-k, 


k-1, and 1 degrees of freedom, respectively. 
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The foregoing procedure for finding at least a lower 
bound for the rank of a quadratic form 
case 
Omer) a (x) 
= ; Lea 
i=l 
endeavors to construct a matrix of known linear restrictions, 


= [Oy ree 7d ] 


k 
whose rank is necessarily the number of linearly independent 


linear restrictions on the linear forms Lire-e rh Trt could 


k* 
be shown that if the linear forms L,,---,l, are linearly 
independent then Theorem 3.1 can be applied to give the rank 
exactly. Such a procedure entails finding the rank of the 
matrix of coefficient vectors, A = [Ayre ++r Ay associated 
with the linear forms Lir-+- Ly. In general, the determina- 
tion of the rank of A is complicated by the odd construction 
of the A,'s. On the other hand the matrix of the known lin- 
ear restrictions, A, contains only elements equal to zeros 
Or ones. Hence, the easier method of finding information 
concerning the rank of a quadratic form is to look for the 
linear restrictions and apply Theorem 2.2 or Corollary 3.3. 
In the next section two-way classification of analysis 
Of variance is investigated and it will be seen that although 


the matrix of known linear restrictions becomes larger deter- 


mining its rank remains relatively easy. 
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B. TWO-CLASSIFICATION 

In the one-way classification of the analysis of variance 
k groups of independent normally distributed observations are 
recorded. The k groups represent k different variations of a 
particular variable or factor which is needed to yield a de- 
Sired result, e.g., the observation itself. It is the purpose 
of the analysis of variance to ascertain if there is any sig- 
nificant differences in the results of any of these variations. 
The measurement of crop yield using different types of ferti- 
lizer is an example of such a grouping or classification. 

In a two-way classification of the analysis of variance 
the results of an experiment are classified according to var- 
lations of two influencing variables. In the crop growth ex- 
ample, crop yield can be classified, not only by different 
types of fertilizer, but also by various soil compositions. 

Suppose there exists r variations of one classification 
and c variations of a second classification. Consider n 
observations taken from each of rc possible combinations of 


the two @lassi fications. in_tasular stern 
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where y = (y,. 


tyre. Ya3 ) is an nxl vector. It is assumed 


yn 
that the rc sets of n observations are random samples from 
rc separate populations, each normally distributed about 


mean Wy but all with the same variance 0%. The model is 


Yijyv ~ ig 7 Sigv 


where e€.. 18s N(O ,6- Let 
TL Ag 


*~ e e 
diay V O 
and consider the identity 


Sune ee EX 2, meg 4 eg ees 


-~X .+x) + (X. -x) 
aes hts is i 


(2) 


eS eee 
( -4 ) 


where 
n 
cS low x. 
iL nee 2 a 
_ 1 fe n cle 
ie aw ) ijv c ) *i 5 
j=l v=l j=1 
_ 1 14 n 1 «© 
*.5 7 ee ) ijv ’ leg 
i=l v=l 1=1 
a 1 i c n 1 ©- 7 c= 
a= romt, Ge © Miser x 2. *1- “-5 
i=l j=l v=l 1=1 j=l 


Squaring both sides of equation (2) and summing over 1, j and 


Wo l= ieee pk ye Ke pcs + A ieee. ,D yields @hevidentity 


2g 


} | fwy- f Fo E45) 
= Ree ) 
i=1 j=l vali] Yee i=l j=lev=le 7% od 
ritec = Ey, r soy 
+n } ) ( SS.) ETM ) (SGrosea ss) 
i=l j=l *J + J i=l 7 
Cc _ _ 9 e 
+ nr ) (x Eee) oF rcnx 
ja. 


tO 
ll 


Q, 2, + 23 7 4 + Os 

The rank of Q is ren since it is We with ren degrees of 
freedom. The ranks of Qype ee Qe can be determined by finding 
the number of linearly independent linear restrictions asso- 
Ciated with each ida ae form and applying Corollary 3.3 
and Theorem 2.4. 


Following the procedure of the previous section consider 


ELSE 
jj ig 
On == (x... —-x..) 
‘ ss, ear hee? 
where 
=i 
a 
-lec +3? 
x = : with Xi. = i=l,. 75 
—_ J j=1, 7c 
e *ijn nece 
=-rl 
x. 2 nx 
x Benx. 13 
=rc 


Si 


Let Lig Me) = (x. .5-x%..) i=],...;e be a linear fOrmean. x 
LA = ay La Tt ee ts: Ze 
= ri. xX Vey. . « i 
where A.. 1s a rcenxl vector 
-1ijv 
0 
: {(i-1)c+j}n rows 
_O_ 
_i 
n 
_i 
n 
i- L ise} 
as = n | ------ { (i-1) c#9 Intv row 
_i 
n 
_i 
__2 
0 
: ren-{ (i-1)c+j+l}n rows 
a 0 reno. 


Per Cach 1, jg 1=1,.-.,0, J=l,.<.,C Sehere exists. am renal 


vector one such that 


o7 oU (x) 


Sli 


where 


(i-l1)c+j n rows 


: ren=-(1i-1) c+j]+)l wm rows 
0 eens) 


and “Goa (iue.. (s)8) 1=l,...,%, j=1,...;C, Val, ee 


reonxl] ’ 


Note” that there are™rc such vectors) Sha Forming the matrix 


A= Ayre rapper Aor esr hsel 


using the nxl sub-matrices 


1 0 
L= ° and 0 = : 
i aly. JL 0 jgipya ll 


A becomes 


a2 


Pye Oh... ... om ...8 
Ly eee. Fe... 08... 0 
O00 .-. 100... 0.-.900..-. 9 
A = ; 
g0)..80@ .20 ... ig” ..% 
OME. Bee... eB... OF... 0 
OnmF..02 80 ..2.D ... OF .... 1 renxrc. 
It can be seen that the columns of A are linearly independent, 
1.e., r(A) = rc; hence by definition, the set of re vectors, 


Maven. > Baws ple Je 


1) 


restrictions on the linear forms {L, 


pis eC, v= nnn 


i 


..,c} are linearly independent linear 


‘oc w-1,...>5%, 


Applying Corollary 3.3, 


r(Q,) < ren-re = rem-1ir 


In a Similar manner for 


re) 

NO 

ry 
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lI 


=i 


) let 
rc 


be a lamear sherrnieain x<)where “aE is a rexl vector 
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She 


Bie. 


a 5 row 
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RIF 
led 9 
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ale 


-—-—= (i-l)c row 


Ni3 dr i a rey row 


iI 
- 
| 
AIR RIF ate 
| ry 
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je 


Se IG. row 
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“cool aa 


Likewise there exist r+c vectors ta, ;i=l,...,4r} and 


fore j=l,..) ,ebuch that 


ae, 
m= | 
a:L(x) = a (x) 
1 fo hg eels 
j - _ 
= (a. oe =X ox) 
j=1 13) +t J 
= 0 
and 
= rc = 
yl = aa 
B4L (x) 2, Bi 4by4 (x) 


a5 


where 


0 
c rows 
ae c rows ‘eal 
. £ gg © 99 Ve ae aie 5 row 
0 
c rows 
OL 
ih 
; ae block th 
a, = : of c rows o5 es a loco. 
: J c rows 
iL 
me ig le ee ee row 
: c rows 
UE 
0 
: c rows 
0 rex 
Crows “S@ 5 Or 2ee2. (r-1)e= iam ee 
Perc 





respectively. 
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Forming the matrix 


= 1 

A [Opes eG By re ee BUS 
i 0 «aS AMO 0 

1 0 GOOol 0 

i Gg Oe. ik 

or 1 Gi &. 0 

2 eo .. 0 

Oo 2 0 O° ® L 

0 0 - 550 © 0 

ow 0 , t © 0 


OU “ee 1 70%". 2 «2 rex (rt+c) 


1t can be seen that 
) } 
O. = Bi r 
isa > = 


Nemo! the rank of A is at most mrc-l. Gonsider the (rtc-1l) 


> 


x(r+c-1) sub-matrix of 





rEL_ Oe... @Ol Ge... al 
Teo... © Ee 1 G 0 
c rows 
¥F 0 © GO Oyo. OC O° a3 
L Gad GC @ 0 Ore. 0 
A* = om 1 © oO. 1 C0. 0 
0 @ i oy @ FO . 0 
r-l rows 
00 0 1-0 O@ U 0 
00 0 ClhO@o sg 1 


ey 


a 
O 
= 

ip 

+ 
] 


+ 1 depending if rt+c-l is odd or even. Consequent- 
ly, r(A) = r+c-1l and bymaefinitren, themset of Wector 


{Q,7++-/%,, By,--+,8,} represent r+c-l linearly independent 


1% 
linear restrictions on the linear forms (Ly 5 (x) 3 i=l,...,X, 
j=1,.--,c} and by Corollary 3.3, r(Q,) < ren-r-c+l = 

(r—-l) te=3 


Consider next 


a E 5 aT, 
Q,(x.-) = ne ) (x, ,-x) 


izl® © 
where Xr = (X1 eee eX.) Let 
L, , (x.) = (x. | -X) I=] 56 te 
=a. Xs 
=. — 


be a linear @omje@in xm where d. is a rxlgyector 


- = rx 
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where 


ie 
ll 


Hemce a represents one linear restriction on the linear 
{L, (x.); i=1,...,ri jana by Goeretiary 3.3, r(Q,) <{ho. 
By an analogous argument r(Q,) aca 
Lastly, Qn (x) — ene 


form, L(x) = Yren x, and: has»mank, mo) = lk. 
5 


in summary, 


where 


Hence, 


5 


) Qy < Sees re rc —r era. + Caaeyr a 


k=1 


but by Theorem 2.4 


rxl 


= 


forms 


is the square of the single linear 


ll 


lA 


[A 


ron 
rcn-re 
re-r-c+l 


r-l 


mQ) = ren < } r(Q,). 


Gensequenthy , 


r(Q,) - r(Q.,) + r(Q3) + r(Q,) + r(Q,) 
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and 


r(Q,) = re(n-1) 
r(Q,) = (r-1) (c-1) 
r(Q,) = r-l 
r(Q,) = c-l 
r(Q.) = 1 
From Cochran's Theorem the quadratic forms Q,,..-,Q, 


are linearly independent and are re distributed with degrees 


of freedom equal to their respective ranks. 


40 


V. "CONCLUSION 


In general it may be difficult to verify that the linear 
forms Lj (x) ,--- DL, (x) are linearly independent directly, or 
when they are not, to find the maximum number of linearly 
independent linear restrictions on them in order to determine 


the rank of the associated quadratic form 


Q(x) = ) 1, (x). 
=] 


i 
Fortunately, it is sufficient only to observe that if there 
are at least m linearly independent linear restrictions, 
then the rank must be less than or equal to k-m. Enough 
information is often then available to establish that no 
more linear restrictions exist. Hence, indirectly, the rank 
is found to be exactly k-m. The application of rank deter- 
mination to analysis of variance is an example of this in- 
direct procedure. 

It may now be stated that the procedure as outlined by 
Cramer [1] and Hald [2] for determining the rank of quad- 
ratic forms has been explicitly justified in detail and 


illustrated. 
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